Amendments to the Drawings: 

The drawings include changes to Figs. 5 and 7. The set of formal drawings replace the original 
sheets. The drawings have been changed as follows: 

Figure 5 has been amended to add flow direction indicators; 

Figure 7 has been changed to separate Fig. 7 into new Figs. 7A and Figure 7B. 

A submission of 15 sheets of Formal Drawings are being filed currently herewith. 
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Amendments to the Title: 

Please delete the title "TEST RESOLVER MANAGEMENT SYSTEM" and replace 
it with the following replacement title: 

CATEGORIZED DATA ITEM REPORTING SYSTEM AND METHOD 
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Amendments to the Specification; 

At the top of page 1 of the specification, insert the following paragraph: 

This is a continuation of application of Serial No. 10/425,775, filed on April 29, 2003, 
which is a continuation of application Serial No. 09/660,204, filed September 12, 2000, now U.S. 
Patent No. 6,558,166 Bl, which is a continuation of application Serial No. 09/141,804, filed on 
August 28, 1998, now U.S. Patent No. 6,168,440 Bl, which is a continuation of application 
Serial No. 09/003,979, filed on January 7, 1998, now abandoned, which is a continuation of 
application Serial No. 08/561,081, filed November 20, 1995, now U.S. Patent No. 5,735,694, 
which is a continuation of application Serial No. 08/290,014, filed August 12, 1994, now U.S. 
Patent No. 5,558,521, which is a division of application Serial No., 08/014,176, filed February 5, 
1993, now U.S. Patent 5,437,554. U.S. Patent No. 5,433,615, U.S. Patent No. 5,752,836, and 
U.S. Patent No. 6,159,018 are hereby incorporated by reference in their entirety. 

Please replace the paragraph beginning at page 3, line 15 with the following paragraph: 

The present categorized data item reporting method and system groups data items into 
predefined categories for analysis and review. In the method, a plurality of data items are 
received. The data items comprise an electronic representation of at least a portion of a person's 
work product. The data items are divided according to predefined categories. The divided data 
items are organized into separate groupings. Finally, the data items in the groupings are reported. 

Please delete the paragraph beginning at page 3, line 21. 
Please delete the paragraph beginning at page 4, line 3. 
Please delete the paragraph beginning at page 4, line 15. 

Please replace the paragraph at page 5, line 6-7 with the following paragraph: 

FIG. 7A is a flow chart of categorized (special) item reporting. 
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Please insert the following paragraph at page 5, line 8: 

FIG. 7B is a flow chart of retrieval and organization of answers according to special item 

definitions. 

Please replace the paragraph at page 14, line 14 with the following paragraph: 

Fig 7 A is a typical flow chart of categorized (special) item reporting. Categorizing item 
reporting allows the system to both group answers according to predefined categories and 
monitor processes used by the students or test-takers in arriving at a given answer. The 
categories in which data items such as test answers may be grouped include, for example, 
incorrect answers and correct answers within a curriculum unit within an instructional grouping 
and requested time frames; for example, all of the incorrect math answers in a particular 
instructor's class during the previous school year. Other groupings are possible depending upon 
the needs of the test resolvers and instructors who teach the material to which the test relates. 

At page 16, line 3, insert the following paragraph: 

FIG. 7B is a more detailed flow chart of step 80 from FIG. 7A. The flow chart of FIG. 7B 
shows the retrieval and organization of answers according to special item definitions. At step 

140, the system retrieves special item definitions from the central application repository. Based 
on the special item definitions, the system retrieves the corresponding answers at one of the steps 

141. The system then organizes the retrieved answers into groupings at step 142. 

At page 16, line 13, please amend the following paragraph: 
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The system at steps 83 and 84 determines if items are available for scoring. At step 85, the 
system receives collaborative scoring requirements from the database and determines at step 86 if 
collaborative scoring is required. Examples of collaborative scoring requirements are illustrated 
below. If collaborative scoring has been specified, the system retrieves the item to be scored from 
the work-in-process database at step 87 and sends the item to resolvers 1 and 2 at steps 88 and 
91. At step 140. the system can prevent resolver 1 and resolver 2 from scorin g the same test item 
if they have average scores within predefined scoring criteria. 
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